Papers by Brigitta Jesica Kartono
COMPASS: A Framework for Evaluating Organization-Specific Policy Alignment in LLMs (2026.acl-long)
Copied to clipboard
Dasol Choi, DongGeon Lee, Brigitta Jesica Kartono, Helena Berndt, Taeyoun Kwon, Joonwon Jang, Haon Park, Hwanjo Yu, Minsuk Kahng
| Challenge: | Large language models are being rapidly adopted across a wide range of domains, including healthcare, finance, and the public sector. |
| Approach: | They propose a framework to evaluate whether large language models comply with policies . they apply COMPASS to eight diverse industry scenarios to validate models . |
| Outcome: | The proposed framework evaluates whether LLMs comply with allowlist and denylist policies. |